A new basic theorem of information theory
نویسندگان
چکیده
منابع مشابه
A new basic theorem of information theory
A new theorem for noisy channels, similar to Shannon's in its general statement but giving sharper results, is formulated and proven. It is shown that the equivocation of the channel defined by the present theorem vanishes with increasing code length. A continuous channel is defined in a manner that permits the application of these results. Detailed proof of the equivalence of this definition a...
متن کاملA Temporal Theory for the Basic Formal Ontology: Theorem Proofs
This document contains theorem proofs for the paper A Temporal Theory for the Basic Formal Ontology. Section 1: Introduction In the following we use P , P ′, P1, . . . and p, p′, p1, . . . to range over occurrent classes and instances, respectively. We use C, C ′, C1, . . . and c, c′, c1, . . . to range over continuant classes and instances. We also use U , U ′, U1, . . . and u, u′, u1, . . . t...
متن کاملThe Basic Theorem and its Consequences
Let T be a compact Hausdorff topological space and let M denote an n–dimensional subspace of the space C(T ), the space of real–valued continuous functions on T and let the space be equipped with the uniform norm. Zukhovitskii [7] attributes the Basic Theorem to E.Ya.Remez and gives a proof by duality. He also gives a proof due to Shnirel’man, which uses Helly’s Theorem, now the paper obtains a...
متن کاملApplications of Baranyai's Theorem in Information Theory
In order to motivate Baranyai's Theorem, let us present an example. Think of the director of a round{ robin tournament (for instance, a football pool or a chess tournament) who has to schedule the rounds of the tournament in such a way that i) each team plays against each other team exactly once, ii) in every round all the teams are occupied, i. e. they have an opponent. Of course, the second r...
متن کاملInformation Entropy As a Basic Building Block of Complexity Theory
What is information? What role does information entropy play in this information exploding age, especially in understanding emergent behaviors of complex systems? To answer these questions, we discuss the origin of information entropy, the difference between information entropy and thermodynamic entropy, the role of information entropy in complexity theories, including chaos theory and fractal ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Transactions of the IRE Professional Group on Information Theory
سال: 1954
ISSN: 2168-2690,2168-2704
DOI: 10.1109/tit.1954.1057459